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Abstract 

Let S{x) be the number of n < x for which a Hadamard matrix of 
order n exists. Hadamard's conjecture states that S{x) is about x/4. 
From Paley's constructions of Hadamard matrices, we have that 

s{x) = n 



log X 



In a recent paper, the first author suggested that counting the 
products of orders of Paley matrices would result in a greater density. 
In this paper we use results of Kevin Ford to show that it does: 

Six) > -^exp((C + o(l))(logloglogx)2) , 
log X 

where C = 0.8178.... 

This bound is surprisingly hard to improve upon. We show that 
taking into account all the other major known construction methods 
for Hadamard matrices does not shift the bound. Our arguments use 
the notion of a (multiplicative) monoid of natural numbers. We prove 
some initial results concerning these objects. Our techniques may be 
useful when assessing the status of other existence questions in design 
theory. 



*The authors are with the IDA Center for Communications Research, 4320 Westerra 
Court, San Diego, CA 92121 USA (email: {warwick,gordon}@ccrwest.org). 
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1 Introduction 



In this paper we use the idea of the density of a set of natural numbers N to 
gauge the progress made so far on the Hadamard Conjecture. In addition, 
we propose that our methodology could be used to assess the status of other 
existence problems in design theory. 

We take a moment to describe some ideas concerning (infinite) subsets 
of N, their sizes and their densities. Section 2 covers these and related ideas 
in more detail. Given a set A of positive integers, we may define a counting 
function A : M — t- N, where A{x) = i^{n < x \ n E A}. The rate of growth of 
this function is used by number theorists to gauge the size of the set A. For 
example, the counting function 7i{x) of the set of primes is approximately 
equal to x/ logx. 

In this paper, sets will be in calligraphic font, and the counting function 
for a set will be the same letter in roman font. We will respectively call the 
function A{x), and the ratio function A{x)/x the size and density (functions) 
of the set A. So the set of odd natural numbers has size about x/2 and density 
about 1/2. 

Hadamard's conjecture states: 

Conjecture 1.1. For every odd number k there is a Hadamard matrix of 
order 2^k for s > 2. 

Let S be the set of orders for which a Hadamard matrix exists, and let 
S{x) be the size function of S. Then, since there are also Hadamard matrices 
of orders 1 and 2, Conjecture II. II is equivalent to: 



Conjecture 1.2. For every x >2, 

S{x)- 



+ 2. 



There are a number of existence theorems for Hadamard matrices, but 
we are far from being able to prove Conjecture II. 2[ The conjecture implies 
that the set S of Hadamard orders has density 1/4. As yet, we have not even 
been able to prove that S has positive density. In this paper we derive lower 
bounds for S{x) using known existence theorems. Using Paley's constructions 
we immediately get a density of 0{x/ logx). Using results on the density of 
values of Euler's totient function we show: 
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Theorem 1.3. For all e > 0, there is an element G N such that, for all 
X > x^, 

S{x) > -^exp((C + e)(logloglogx)2) (1) 
log X 

forC = 0.8178.... 

In Section [3] we show that the bound ([1]) is the best we can obtain given 
the currently known major constructions for Hadamard matrices. This is per- 
haps surprising, since ([T]) is obtained by taking Kronecker products of Paley 
Hadamard matrices only. So one might expect that the bound could be im- 
proved by incorporating the many other known constructions for Hadamard 
matrices. 
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Figure 1: Density of Hadamard orders from different constructions 

Figure 1 shows plots of three lower bounds for S{x). These are obtained 
by taking into account the orders of various classes of known Hadamard 
matrices. The weakest bound is obtained using Paley orders 2"(p+ 1), where 
a > 1 if p = 1 (mod 4), and a > otherwise. The second bound takes 
products of these orders, and the best bound adds products of the known 
Hadamard matrices of order up to 10000, and the constructions described 
in Section |3l We show in that section that these two bounds are in fact 
asymptotically equal. Indeed the impact of the table of known orders less 
than 10000 seems to fade quite rapidly. 

The Paley bound is weaker than the others, but is still stronger than 
the bounds given by the asymptotic existence results proved by Seberry and 
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Craigen and Kharaghani. Interestingly, Figure 1 shows that the Hadamard 
Conjecture is decided in the affirmative for about one half of the orders n = 
(mod 4) of size about one billion. So at least for "small" orders we are doing 
quite well. 

We think that the notion of density has a wider applicability in the context 
of design theory. Typically, design theorists gauge the progress on a problem 
by creating tables of known orders and undecided cases. For example, we 
now know that Hadamard's Conjecture holds for nearly all orders less than 
10 000. However, many of the known constructions arise from algebraic or 
computer constructions which may fail to cover all cases as the upper bound 
on the orders to be covered is increased. So success for small orders may be 
misleading. 

The existence question for Williamson matrices is a good example of this 
phenomenom. Williamson matrices of order t can be used to construct a 
Williamson-type Hadamard matrix of order 4t. In [9] the authors obtain by 
computer search Williamson matrices of order 23, and thereby construct a 
Williamson-type Hadamard matrix of order 92. Flushed with this success, 
they then suggest that Williamson type Hadamard matrices exist for every 
order divisible by four. Indeed, subsequent computer searches conffimed that 
Williamson matrices exist for all odd orders up to and including 33. However, 
in [5] it was shown that no Williamson matrices exist for order 35, and since 
then additional computer searches [TD] showed nonexistence for several more 
orders, so that now the question of how common Williamson matrices are for 
larger orders is quite unclear. 

Therefore, there is a need for some other more global measure of the sta- 
tus of a design-theoretic existence question. Since such existence questions 
usually involve two infinite sets: one consisting of the decided orders and 
another consisting of the undecided orders, we think that the discrepancy 
between the sizes of the set of undecided orders and the set of decided or- 
ders provides a precise mathematical measure of the progress made on such 
existence questions. 

The rest of this paper is divided into three parts. Section 2 derives a 
series of lower bounds for S{x). These bounds are all implied by Paley's 
construction for Hadamard matrices. Section 2 also contains a proof of The- 
orem [L3l Section 3 contains a proof that taking into account the other major 
constructions for Hadamard matrices does not lead to a larger lower bound 
for S{x). The proof uses the idea of a monoid of natural numbers: i.e., a 
set of natural numbers containing 1 which is closed under multiplication. 
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The final part of tlie paper is a teclinical appendix wliicli proves two results 
concerning monoids which are needed in Section 3. The first part of the ap- 
pendix contains elementary proofs of the monoid theorems, and the second 
part of the appendix gives proofs using results about generating functions. 

2 Lower Bounds for S(x) Using Paley Hadamard 
Matrices 

In this section, we use Paley's family of Hadamard matrices to obtain three 
increasingly stronger lower bounds for S{x). 

2.1 A Simple Lower Bound 

Theorem 2.1 (Paley). For any prime q, there is a Hadamard matrix of 
order n, where 



Diri chiefs Theorem on primes in arithmetic progressions implies the fol- 
lowing corollary: 

Corollary 2.2. 



Proof. One has (1/2 + o{l))x/ logx orders from primes = 3 mod 4 up to x, 
and (1/4 + o(l))a;/ logo; from primes = 1 mod 4 up to x/2. An order m is in 
both sets if p = m — 1 and g = m/2 — 1 are both prime. Since 2q + 1 = p, 
these are Sophie Germain primes. Brun's sieve may be used to show that 
the number of Sophie Germain primes up to x is 0(a;/(loga;)^) (see [IS]), so 
this overlap does not affect the density. □ 

2.2 An Improvement 

A Hadamard matrix of order n can be used to construct one of order 2n, so 
we have ones of order 2*(g + 1) for t > 1 for all primes q. This improves the 
bound in Corollary 12. 2t 



n = 



g + 1, if q = 3 (mod 4), 
2(g + 1), if q = l (mod 4). 




5 



Corollary 2.3. 

Six) > (1 + 0(1)'^ ^ 



log X 

Proof. We use the following slightly stronger version of the Prime Number 
Theorem: 

log X log X V log X , 

As before, we have (l/2 + o(l))x/ log a; orders from the primes = 3 mod 4 up 
to X. 

Now consider the set of orders 2{p + 1) for all p < x/2. The number of 
these orders is 

, , , x/2 x/2 ^ ( X 

7r(x/2) = , / + , ' ,^, +0' 



log(x/2) log2(x/2) Vlog a; 
X / 1 + log 2\ X ^ ( X 



21ogx ' V 2 ) log^x Vlog^x 
Similarly, from all primes p < x/2^ for A; < logo; we get 



log(x/2fc) ' log^(x/2'=) ' ^ Vlog^a; 
X 1 + k log 2 a; 



+ 



2'^logx 2^ log X vlog a: 

orders of the form 2^[p + 1). Summing these terms, the coefficient of x/logx 
converges to 3/2, and the coefficient of x/ log^ x also converges. 

The final step is to ensure that the intersection of the sets is small: the 
number of orders m with p = m/2'' — 1 and q = m/2^ — 1 for primes p 
and q is o(x/loga;). As for Corollary 12. 2^ the number of such orders for 
any individual r and s is 0(x/log^a;) using Brun's sieve. Furthermore, we 
need only consider r,s < 2 log log x, since the number of primes p up to 
m/2^^°^'°^^ is 0(a:/log^x), and so the number of orders m = 2'^{p + 1) is 
0(x/log^x). Combining these results, the number of orders in more than 
one set is o(a;/ logx). □ 
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2.3 Proof of Theorem II. 3t Further Improvements Via 
Products of Paley Matrices 

Given Hadamard matrices of orders a and 6, it is easy to construct a Hadamard 
matrix of order ah, but [IJ and |1] show that we can do better: 

Theorem 2.4. If Hadamard matrices of order Aa and Ah exist, then there is 
a Hadamard matrix of order 8ah. 

Theorem 2.5. If Hadamard matrices of order Aa, Ah, Ac and Ad, exist, then 
there is a Hadamard matrix of order 16ahcd. 

We want to show that applying these theorems to Paley Hadamard ma- 
trices will give us a greater density. An improvement follows immediately 
from a result of Erdos. He showed that the number of different values of 
m = (p + l)(g + 1) up to X, for p and q prime, is (1 + o{l)) ^^^°^^^^K Thus 

5(x)>(l + o(l))-^(loglogx). 
log a; 

Thus we have an immediate improvement by taking into account Theo- 
rems 12.41 and 12.51 

A further improvement follows from theory that has been developed to 
analyze the distribution of values of the Euler totient function. The new 
bound (which is somewhat complicated) will imply that, for any a > 0, 

S{x) > (1 + o(l))-^(loglogx)" . 
logx 

Recall that the Euler totient function (p{n) is the number of positive 
integers less than n which are relatively prime to n. This is a multiplicative 
function with value at prime powers: 

^(p'^)=p-i(p_l). 

Let V{x) be the number of distinct values of Euler's (^-function less than 
X. The study of the growth of V{x) has a long history. In 1929 Pillai pT| 
showed 

V(x) < p^TT . 

log ^ ' X 
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In 1935 Erdos [H] improved this to 

V{x) < ^ 



Wi+o(i) 



X 



The 0(1) was subsequently made more precise by Erdos and Hall, Pomerance, 
Maier and Pomerance, and finally Ford [8], who showed 

Vix) = exp (C( log log log X — log log log logs) ^ (2) 

logx ^ 

+L'logloglogx -{D + 1/2- 2C) log log log log X + 0(1)) , 

where C = 0.8178 ... and D = 2.1769 . . .. 

Ford proved that this bound applies to any multiplicative function / 
satisfying two conditions: 



{f{p) — P '■ P prime} is a finite set not containing (3) 
< 1 , e{h) = exp (log log /i (log log log /i) ^° ) . (4) 



^ f{h) 



h>16 square ful 

Note that n G N is squareful if, for all primes p, p\n implies p^|n. 

Proof. (Proof of Theorem 11.31) We now use Ford's general theory to prove 
Theorem 01 We take f{p^) = f2{p^) = {p+ ^Y- Then condition (I3]) holds. 
Moreover, f2{x) > ip{x); so @ holds for / = /2, since it holds for f = ip. 
Thus Ford's result implies, that the set of integers up to x of the form 

(pi + 1)"HP2 + 1)"^ ■ ■ ■ (Pfc + 1)"'= (5) 

has density of the same form as the righthand side of (|2]). This expression is 
only determined up to the "0(1)" term in the exponent. Nevertheless, since 
(by Theorems 12.11 and 12. 4p there are Hadamard matrices for all orders 2t, 
where t has the form ([5]), S{x) is bounded below by a function of the form 
on the righthand side of (|2]). Theorem 11.31 now follows. □ 

One issue, involving powers of two, remains to be discussed. For each 
prime pi = 1 mod 4 in ([5]), the order of the Paley matrix is 2{pi + 1), not 
Pi + 1. However, this is offset by Theorems 12.41 and 12. 5[ which show that if 
ai + 0:2 + ■ ■ ■ + Ofe = v4, we may divide (|5]) by a factor of two raised to the 
power: 

4 [(A - 1)/3J + {(A-l) mod 3). 
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Potentially this could give us an increase in our lower bound for S{x), say 
if we had a large number of integers in S{x) with X] '^i — log log x. However, 
Ford's Theorem 10 (and its generalization to other multiplicative functions) 
shows that almost all integers in S{x) have 

= 2C(1 + o(l))logloglogx 

i 

as X — > oo. Therefore the savings from dividing out by powers of two does 
not affect the main term in Theorem 11.31 

3 The Impact of Other Constructions 

In this section, we show that our best lower bound for S{x) cannot be im- 
proved by taking into account other large classes of known Hadamard matri- 
ces. In order to do so, we introduce the following key idea: 

Definition 3.1. A subset .4 of N is called a (multiplicative) monoid if 

• 1 & A, and 

• a,b & A implies ab G A. 

The set Q generates a monoid Ai if every element in is a product of 
elements in Q. 

Notice that if A and B are monoids, then the product set AB = {ab : 
a E A, b E B} is a monoid. 

Our interest in monoids stems from the observation that the set of known 
Hadamard orders is closed under multiplication: i.e., the product nin2 of 
two known Hadamard orders ni,n2 is also a known Hadamard order. In- 
deed, any construction for Hadamard matrices generates a monoid of known 
Hadamard orders via the Kronecker product and the product results Theo- 
rems 12.41 and 12.51 

Our overall plan in this section will be to determine the size of the monoid 
generated by each major known construction, and then to determine the size 
of the product of these monoids. 

The following theorem allows us to determine the size of the products of 
the monoids encountered in this section. It is perhaps surprising that taking 
finite products of monoids often does not give a significantly larger monoid. 
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Theorem 3.2. Suppose that A, B, and C = AB are monoids such that 
A{x) = 0{x") and B{x) = fi(x^), where < a < /3 < 1. Then C{x) = 
0{B{x)). 

So up to a constant factor, the product monoid has the same size as the 
larger of the two monoids. 

We will also need a result which bounds the size of a monoid in terms of 
the size of its generating sets. The next theorem shows that if a monoid has 
a fairly small generating set, then the monoid itself is not much larger. 

Theorem 3.3. Let Q be a subset of N such that G{x) = 0(x"), for some 
a G (0, 1). Let Jvi be the monoid generated by Q . Then M{x) = Oi^x^^") for 
all e > 0. 

Notice that a monoid has a unique minimal generating set: namely, the 
set of elements in the monoid which are not the product of strictly smaller 
elements of the monoid. The theorem of course applies to any generating 
set. See the Appendix for proofs of Theorems 13.21 and 13. 3[ 

The following families are given in the survey article [3]: 

1. Hadamard matrices exist for every order < 662. Tables of known orders 
2*g are given for odd g < 9999. 

2. A Hadamard matrix of order 2*g for odd g exists for 

t>6 ^ +2. 

16 

3. For g odd with k nonzero digits in its binary expansion, there is a 
Hadamard matrix of order 2^g when 

(a) g = l (mod 4) and t > 2k, 

(b) ^ = 3 (mod 4) and t > 2A; - 1. 

4. For q a prime power, q ^ 7 (mod 8) a Hadamard matrix of order 4g^ 
exists. 

5. For q odd, a Hadamard matrix of order Aq'^ exists. 

6. If n — 1 and n + 1 are both odd prime powers, then there exists a 
Hadamard matrix of order n^. 
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We also note the large class of cocyclicjl] Hadamard matrices: 



7 Let pi,p2, . . . ,Pr = 1 (mod 4) and let qi,q2, ■ ■ ■ ,qs = 3 (mod 4) be 
prime powers. Then, for all ai, a2, ■ ■ ■ , ctr, Pi, /32, • • • , /3s > 0, there is a 
cocylic Hadamard matrix of order 



We first observe that the orders in the last class form a monoid A^y whose 
size has the same form as V{x). To see this, we define f^ip^) = + 1), 

and then apply Ford's theorem. Notice that /3(x) > v?(x); so condition (jl]) 
holds for /s since it holds for the totient function Lp. 

Notice also that, if Jvl'j includes all the orders obtained by applying The- 
orems and to the orders listed under item 7, then A^y contains all the 
orders identified in the previous section. Moreover, the argument at the end 
of Section 2 implies that M-j and Ai'-j have about the same size. 

We now show that the Hadamard orders given by constructions 1-6 in 
combination generate a monoid whose size is quite small. 

Theorem 3.4. The monoid M. generated by all the orders given by construc- 
tions 1-6 has size 0{x^f^^^^), where e > may be taken as close to zero as 
one pleases. 

Proof. We consider the constructions 1-6 listed above in order: 

1. The first construction generates a monoid Aii which has a finite num- 
ber of generators. So M.i fl [l,x] has size 0((logx)"), where a is the 
number of generators. 

2. Let A^2 be the monoid generated by the set ^2 of orders given by the 
second construction. Then A^2 is not much smaller than the set 



where e = 3/8. The number of elements in this set is about equal to 



r s 



\{2pT{p^ + l)\{qHQ^ + ^)■ 



i=l i=l 



{2^g I where g is odd and t > e log2 g} 




1 




3^+"^ odd <x 



Cocyclic Hadamard matrices correspond to certain relative difference sets. 
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3. To assess the size of the monoid Ai^ given by this construction, we 
apply Theorem 13.31 

Let ^3 be the set of orders 2^g satisfying parts (a) and (b) of item 3 
above. Then generates A^s. We now estimate the size of fl [1, x]. 
Put n = [loggx], and suppose 2^g G ^3 fl [l,x]. If 5^ = 1 (mod 4) 
has has exactly k digits equal to 1, then the bottom 2k digits of the 
binary expansion of 2^g must be zero, and the remaining n — 2k digits 
must contain exactly k Is. This gives at most possibilities. If 

g = 3 (mod 4) has exactly k digits equal to 1, then the bottom 2k — 1 
digits of the binary expansion of 2^g must be zero, and the remaining 
n — 2k + l digits must contain exactly k Is. This gives at most {"'~'^^^^) 
possibilities. So 



There are at most n summands, and the largest of these occurs when 
k !^ n/A. So G^{x) = 0{x2~^'^) for any e > 0. Theorem 13.31 now implies 
that Msi^x) = 0(a;2+') for any e > 0. 

4. Constructions 4, 5 and 6 all give orders lying in the monoid A^4 
of square orders. So the monoid generated by these orders has size 



The monoids A^i, A^2, A^s and A^4 all have size 0{x^) where 6 > 8/11 
may be taken as close to 8/11 as one pleases. So Theorem 13.31 implies the 



From Theorem 13.41 and Theorem 13.21 we see that constructions 1-7 do not 
increase the asymptotic bound for S{x): 

Theorem 3.5. The monoid Aio generated by constructions 1-7 has size 




0(xl/2). 



result. 



□ 



X 



exp ((C + 0(1)) (log log log x)^) 



log a; 



forC = 0.8178.... 
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A Monoids and Sets of Natural Numbers 

In this appendix, we prove two theorems showing that taking products of 
sets does not greatly increase asymptotic density. We give two sets of proofs; 
one elementary and self-contained, and the other shorter but depending on 
results on generating functions. 

In this paper, we use some standard notation to discuss the growth of the 
counting function of a set: Let / : N — )■ M be a function. Then 

• = 0{f{x))" means that there is a constant C > and G N 
such that A{x) < Cf{x) for all x > xo, 

• ''A{x) = ^l{f{x))" means that there is a constant C > and xq E N 
such that ^4(0;) > Cf{x) for all x > Xq. 

• '^A{x) = Q{f{x))" means that there arc constants Ci > C2 > and 
Xo e N such that Cif{x) > A{x) > C2f{x) for all x > Xq. 

• '^A^x) = o{f{x))" means that for any constant C > there is some 
Xo e N such that A{x) < Cf{x) for all x > xq. 

A.l Elementary Proofs 

For any subset ^ of N and any x e N, let 

a{x) ^\Ari{x/2,x]\ and a{x) ^ \Ari[x/2,x]\ . 

Lemma A.l. Let A,B and C = AB be subsets of N which are monoids. 
Then, for all x eN, 



Moreover, if the righthand side is bounded by a constant Ci, say, for all x eN, 




then C{x) = e{B{x)). 
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Proof. Since every element of C fl {x/2,x] can be written in the form ab, 
where, for some k G {1,2,..., [loggx]}, a e An [2^"\ 2*^] and b e Bn 
(x/2''+\ a;/2''~^], we have 

c{x) < J2 + b{x/2''))a{2^) . 

k=l 

Dividing through by b{x) then gives IQ. We now prove the second part of 
the lemma. By hypothesis, we have 



.X w X (b(x/2''-') + b(x/2^))a(2'') I 

C{X) < b{x) I J2 / y ) ^ < . 



(6(x/2'=-i) + b{x/2^))a{2'') 

k=l 

Now we have the following partition 



riog2 2:^1 

Cn[l,x]= y C n (a;/2^ a;/2^-i] 
fe=i 

for C n [l,x] and a similar partition for i3 fl [1, x]. So 

= ^ c(x/2'=-i) < ci ^ 6(a;/2'=-i) = c^B{x) . 
fc=i fc=i 

Since i3 C C, we then have < C{x) < ciB{x). This completes the proof 
of the second part of the lemma. □ 

Proof of Theorem \3.2[ For some constants Ci, C2 > 0, 

'x\l^ fx\P 



Now 



b{x) = B{x) - B{[xl2\ ) > c,x^ - C2 (I) = (I) {2^c, - c^) 



^'^"^ {b{x/2^-') + 6(a:/2^))a(2^) ^ ^'^"^ B{x/2^~^)A{2^) 

^ b(x) ~ ^ b(x) 

k=i ^ ^ k=i ^ ' 

k=l 



X 



<C4 £ 2'^^ 



k=l 
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which is bounded since a < [3. So Lemma [A . 1 1 imphes that C{x) = Q{B{x)). 

We now prove Theorem 13.31 that the size of a monoid is at most shghtly 
bigger than its generating set: 

Proof of Theorem \3^- Fix e > 0. We prove M{x) = 0(x"+'). Put 
ao = a + e/2. Let xq be such that G{x) < for all x > Xq. Let 

Go = G ^ [1, Xq), and let Qi = Q H [xq, oo). Let JHq be the monoid generated 
by Qq, and let A^i be the monoid generated by Qi. Then the following 
statements hold: 

(A) < 

(B) Mo(a;) = 0((logx)l^ol), 

(C) M=MoMi, 

(D) M{x) < Mo{x)Mi{x) = 0((logx)l^olMi(a;)). 

So, noting item (D), in order to prove that M{x) = 0(x"^^), it is sufficient 
to prove that Mi(x) = 0{x°'^), for all ai G (ao, a + e). 

Fix ai G {ao,a + e). We prove Mi(x) = 0(x"^). Let n = [log2a;'|. 
Any element y of Aii fl [l,x] corresponds to a partition of n as follows: 
Suppose y = yiy2 ■ ■ - yr where < 2/2 < ■ ■ • < 2/r are elements of ^1. Put 
Oj = [log2 yi\ . Then ai + 02 + . . . ctr = ^ ^ 1^, and < ai < 02 < • ■ ■ < 
ttr- Thus replacing a^. with aj. = + n — m, we see that any product 
y = yiy2 ■ ■ - yr £ A^i n of r elements ?/i of ^1 maps to a partition of 
n into at most r pieces. The number of such y sequences j/i, j/2, . . . , 2/r with 
[log2 yi\ = tti is at most 

Now Hardy and Ramanujan showed that the number p{n) of partitions of n 
is asymptotic to 

exp(7r ^2n/3)/AnV3 = 0{x^) , 
for all 6 > 0. So, choosing 6 = ai — ao, we have 
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A. 2 Proofs using Generating Functions 

We will use generating functions to show that these constructions do not 
increase the density of known Hadamard orders. Since we are interested in 
the properties of products of sets C = AB, functions of the form 



are useful, since multiplying elements corresponds to adding the powers in 
terms of the series. In the context of smooth numbers, Bernstein ^ estimated 
such functions by looking at 



a{z) = J^afcz'^ := ^ z^iog^nj 
fc>o neA 



These series have many fewer terms, and so are easier to analyze. Note that 
= A{2^) — ^(2^^"^) is the number of fc-bit elements of A. We will prove 
results about a^, i.e. A{x) for x a power of two, but since A{x) is monotone 
increasing, and all the coefficients of the generating function are nonnegative, 
this will suffice. 

Lemma A. 2. Let C be the set of products of elements of sets A and B with 
series a{z) andh{z). Then 

dz) < a z) ^ ' 



l-z 



Proof. The coefficient of 2;" in a{z)Y^ = a{z)h{z){l + z + z ■ ■ ■) is 

n 
k=0 



Any n-bit element of C can be written as a product of a k-hit element of A 
and an element of B of at most n — k bits. □ 

We may use the analytic properties of series like this to bound the size 
of the corresponding counting function. Flajolet and Sedgewick [7] give a 
wealth of such results. Their Theorem IV. 7 relates the growth rate of power 
series coefficients to singularities of the corresponding function: 
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Theorem A. 3. If f{z) = fn^"' has positive coefficients and is analytic at 
and 

R = sup{r > 0|/ is analytic at all points of < z < r} 
then limsup|/„|i/" = (V^)- 

From Corollary 12.21 we have Sk = 0(2*^^^'^^'^) for any e > 0, so by the ratio 
test the radius of convergence of s{z) is 1/2. The coefficients of generating 
functions for the other monoids have smaller growth, and so a larger radius 
of convergence. Theorem VI. 12 of ^ shows that the size of the product set 
AB = {ab\a E A,b G B} of two sets with different growth rates is a constant 
times the size of the larger set, proving Theorem 13.21 

Theorem A. 4. Suppose a{z) = ^ cin^" ond b{z) = ^ bnz"" are power se- 
ries with radii of convergence a > (3 > 0, respectively. Suppose bn-i/bn 
approaches a limit b as n — )■ oo. // a{b) ^ 0, then Cn ~ a{b)bn, where 
YjCnZ'^ = a{z)b{z). 

Finally consider the monoid generated by a set A. The generating func- 
tion for the monoid will be 

Exp(a(2;)) := exp (^a{z) + ^a.(-2^) + ^a{z^) H ^ • 

This function has the same radius of convergence as a{z) (see Section IV.4 
of [T]), giving Theorem 13.31 
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